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Abstract 

A long standing problem of Gian-Carlo Rota for associative algebras is the classification of all linear 
operators that can be defined on them. In the 1970s, there were only a few known operators, for example, the 
derivative operator, the difference operator, the average operator, and the Rota-Baxter operator. A few more 
appeared after Rota posed his problem. However, little progress was made to solve this problem in general. 
In part, this is because the precise meaning of the problem is not so well understood. In this paper, we 
propose a formulation of the problem using the framework of operated algebras and viewing an associative 
algebra with a linear operator as one that satisfies a certain operated polynomial identity. This framework 
also allows us to apply theories of rewriting systems and Grobner-Shirshov bases. To narrow our focus more 
on the operators that Rota was interested in, we further consider two particular classes of operators, namely, 
those that generalize differential or Rota-Baxter operators. As it turns out, these two classes of operators 
correspond to those that possess Grobner-Shirshov bases under two different monomial orderings. Working 
in this framework, and with the aid of computer algebra, we are able to come up with a list of these two 
classes of operators, and provide some evidence that these lists may be complete. Our search has revealed 
quite a few new operators of these types whose properties are expected to be similar to the differential 
operator and Rota-Baxter operator respectively. 

Recently, a more unified approach has emerged in related areas, such as difference algebra and differential 
algebra, and Rota-Baxter algebra and Nijenhuis algebra. The similarities in these theories can be more 
efficiently explored by advances on Rota's problem. 
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1. Introduction 



Throughout the history of mathematics, objects are often understood by studying operators 
defined on them. Well-known examples are found in Galois theory, where a field is studied by 
its automorphisms, and in analysis and geometry, where functions and manifolds are studied 
through derivatives and vector fields. These operators abstract to the following linear operators 
on associative algebras. 

automorphism P(xy) - P(x)P(y), (1) 

derivation 5(xy) = 6(x) y + x 6(y). (2) 

By the 1970s, several more special operators, denoted by P below with corresponding name and 
defining property, had been studied in analysis, probability and combinatorics, including, for a 
fixed constant A, 



average 
inverse average 
(Rota-)Baxter (weight A) 
Reynolds 



P(x)P(y) = P(xP(y)), (3) 
P(x)P(y) = P(P(x)y), (4) 
P(x)P(y) = P(xP(y) + P(x)y + Axy), (5) 
P(x) P(y) = P(x P(y) + P(x)y- P(x) P(y)). (6) 



Rota (1995) posed the question of finding all the identities that could be satisfied by a linear 
operator defined on associative algebras. He also suggested that there should not be many such 
operators other than these previously known ones.^j Even though there was some work on 
relating these different operators ( Freeman , 1972 ), little progress was made on finding all such 
operators. In the meantime, new identities for operators have emerged from physics, algebra and 
combinatorial studies, such as 



Nijenhuis 
Leroux's TD 
derivation (weight A) 



P(x)P(y) = P(xP(y) + P(x)y-P(xy)), (7) 
P(x)P (y) = P(xP(y) + P(x)y - xP(l)y), (8) 
5(xy) = 6(x)y + x 6(y) + A 6(x) 6(y) . (9) 



The previously known operators continue to find remarkable applications in pure an d applied 
mathe matics. For different ial operators, we have the d evelopment of differential algebra ( Kolchin , 
1985 ), differen ce algebra ( Cohn , |l965 ; ^evin , |2008 ), and quantum differential operators (L unts 



and Rosenberg, 1997| 1999). For Rota-Baxter algebras, we note their relationship with the clas- 
sical Yang-Baxter equation, operads, combinatorics, and most prominently, the renormalization 



Email addresses: liguo@newark . rutgers . edu (Li Guo), wysccOsci . ccny . cuny . edu (William Y. Sit), 
rhzhang@ynu . edu . cn (Ronghua Zhang). 

1 The following is quoted from Rota's paper. "In a series of papers, I have tried to show that other linear operators 
satisfying algebraic identities may be of equal importance in studying certain algebraic phenomena, and I have posed 
the problem of finding all possible algebraic identities that can be satisfied by a linear operator on an algebra. Simple 
computations show that the possibility are very few, and the problem of classifying all such identities is very probably 
completely solvable. A notable step forward has been made in the unpublished (and unsubmitted) Harvard thesis of 
Alexander Doohovskoy." He also remarked that a partial (but fairly complete) list of such identities are Eq. (l)-(6). 
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of quantum field theory through the Hopf algebra framework of Connes and Kreimer (Connes 



and Kreimer, 


2000; Guo and Keigher 


, 2000. ; 


1008; 


Aguiar , 


2001 


; Andrews, Guo, Keigher, and 


Ono, 


2003 


; |2brahimi-Fard, Guo, and Kreimer 


2004 


; Ebrahimi-Fard, Guo, and Manchon , 


2006 


Guo and Sit, 


2006; 


Bai, 2007 


; |2brahimi-Fard and Guo , 


200! 


] ; puo and Zhang , 


2008 


)• 



1.1. Our approach 

These interesting developments motivate us to return to Rota's question and try to understand 
the problem betterj^Jln doing so, we found that two key points in Rota's question deserve further 
thoughts. First, we need a suitable framework to formulate precisely what is an "operator iden- 
tity," and second, we need to determine key properties that characterize the classes of operator 
identities that are of interest to other areas of mathematics, such as those listed above. 

For the first point, we note that a simplified but analogous framework has already been 
formulated in the 1960s and subsequently explored with great success. This is the study of PI- 
rings and Pi-algebras, whose elements satisfy a set of polynomial identities, or Pis for short 
(Procesi, 1973; ^owen , 1980; prensky and Fromanek , 2004). 



Let k be a commutative unitary ring. In this paper, all algebras are unitary, associative k- 
algebras that are generally non-commutative, and all algebra homomorphisms will be over k, 
unless the contrary is noted or obvious. 

Recall that an algebra R satisfies a polynomial identity if there is a non-zero (non-commutative) 
polynomial <f>(X) in a finite set X of indeterminates over k (that is, <p(X) e k(X), the free algebra 
on X) such that (p(X) is sent to zero under any algebra homomorphism / : k(X) — > R. To 
generalize this framework to the operator case, we shall introduce formally in Section 2 the notion 
of operated algebras and the construction of the free operated algebra kp"|] on X, which shall 
henceforth be called the operated polynomial algebra on X. An operator identity will correspond 
to a particular element (p{X) in k|]X[j. Analogous to Pi-algebras, an OPI-algebra R is an algebra 
with a k-linear operator P, a finite set X, and an operated polynomial (f>{X) e k[]X|J such that 
4>{X) is sent to zero under any morphism (of operated algebras) / : k[]X[] — > R. The operated 
polynomial 0, or the equation <p{X) = 0, is called an operated polynomial identity (OPI) on R and 
we say P (as well as R) satisfies the OPI (p (or (p{X) = 0). 

As a first example, a differential algebra^] is an OPI-algebra R with operator <5, where the OPI 
is defined using X = \x,y] and <p{x,y) := [xy\ - \_x\y - x\y\, where [J denotes the operator in 
kp"!] = k[]x,;y|]. As a second example, a difference algebra S is an OPI-algebra where the k- 
linear operator P is an endomorphism, th at is, (S, P) sa tisfies P(r)P(s) = P(rs) for all r, s e S . A 
common difference algebra (taken from ( |^evin , 2008, pp. 104-5)) is the following: Let zo e C, 



where C is the field of complex numbers, and let S be the field of all functions f(z) of one 
complex variable z meromorphic in the region U = {z e C | (Re z)(Re zo) ^ 0} (so that z + zo e U 
for all z 6 U), then the shift (or translation) operator P taking f(z) e S to f(z + zo) e S is an 
automorphism of S , making (S, P) an (inversive) difference algebra. 

With all operator identities understood to be OPIs in k[jZ|j, the second point mentioned above 
may at first be interpreted as follows: among all OPIs, which ones are particularly consistent with 



2 Disclaimer: We are still exploring the best way to formulate Rota's problem and nothing in this paper is meant to 
provide a definitive formulation. 

3 We illustrate only with an ordinary differential algebra, where the common notation for the derivation is 6. In this 
paper, we have three symbols for the operator: [ J, P, and S, to be used respectively for a general (or bracketed word) 
setting, the Rota-Baxter setting, and the differential/difference setting; often, they are interchangeable. We use [J for 
k|pCl] to emphasize that kpTU is not the differential polynomial ring. Any dependence of the operator on parameters is 
suppressed, unless clarity requires otherwise. 
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the associative algebra structure so that they are singled out for study? This is a subtle question 
since one might argue (correctly, see Proposition 2.10) that any OPI defines a class of (perhaps 
trivial) operated algebras, just like any PI defines a class of algebras. We approach this by making 
use of two related theories: rewriting systems and Grobner-Shirshov bases. 

First, we shall regard an OPI as a rule that defines a rewriting system^] and study certain 
properties of this rewriting system, such as termination and confluence, that will characterize 
OPIs of interest. Termination and confluence are essential and desirable properties since we 
discovered our lists of OPIs by symbolic computation. As a rewriting rule, an OPI <p can be 
applied recursively and if not carefully done, such applications may lead to infinite recursion, 
in which case, it is no longer computationally feasible to derive meaningful consequences on 
the associative algebra from the OPI (p. An example is the Reynolds operator identity in Eq. (6), 
where, if taken as a rewriting rule by replacing the equal sign with — », the right hand side contains 
the expression P{x)P{y), which equals the left-hand-side, leading to more and more complicated 
expressions as the rewriting rule is applied repeatedly ad infinitum. 

By putting aside for now OPIs like the Reynolds identity, we in effect restrict the class 
of OPIs under investigation and this allows us to apply symbolic computation to search for a 
list of identities for two broad families that include all the (other) previously mentioned OPIs. 
One family of operators consists of the OPIs of differential type, which include derivations, 
endomorphisms, differential operators of weight A, and more generally operators 6 satisfying an 
OPI of the form<^ := \_xy\—N(x,y), where N(x,y) is a formal expression in k|]x,;y[] in differentially 
reduced form, that is, it does not contain any subexpression of the form \ uv\ for any u, v e k[br, yl| . 
The other family consists of the OPIs of Rota-Baxter type, which include those defining the 
average, Rota-Baxter, Nijenhuis, Leroux's TD operators, and more generally OPIs of the form 
<f> '■- WLyJ _ lM(x,y)] where M(x,y) is an expression in k[]x,3>U in Rota-Baxter reduced form, 
that is, it does not involve any subexpression of the form L"JL V J f° r an y M > v e k[]x,;y|].[^] 

These two families share a common feature: each OPI involves a product: xy for differential 
type, and lx][y] f° r Rota-Baxter type. These families of OPIs thus provide properties arising 
from the associativity of multiplication, which we can explore in our computational experiments. 
More generally, for an OPI that gives rise to a terminating rewriting system, the associative law 
imposes various confluence constraints that may be satisfied by some operated algebras, but not 
by others. Thus, another advantage of the rewriting system approach is that we may use such 
constraints as criteria to screen OPTalgebras for further research. 

In Section 2 of this paper, we begin the construction of the free operated algebras k[]XU 
using a basis of bracketed words in X. This will be the universal space for OPIs by which we 
formulate Rota's problem precisely in a general setting of a free operated algebra satisfying an 
OPI <p. In Section 3, we develop Grobner-Shirshov bases for free operated algebras and prove the 
Composition-Diamond Lemma (Theorem 3.13). In Section 4, we define operators and operated 
algebras of differential type and propose a conjectural answer to Rota's Problem in this case 
with a list of differential type OPIs. As evidence of our conjecture, we verify in Section 4.2 
that the operators in our list all satisfy the properties prescribed for a differential type operator, 
and in Section 5, we prove several equivalent criteria for an OPI <p in k|Jx,ylJ in differentially 
reduced form to be of differential type (Theorem 5.7), a result that connects together the rewriting 



4 We remind the reader that a term rewriting rule is a one-way replacement rule that depends on a term-order, unlike an 
equality or a congruence. 

5 This, by definition, excludes the Reynolds operator as it stands. However, if we rewrite the Reynolds identity as 
P(P(x)P(y)) = P(xP(y)) + P(P(x)y) - P(x)P(y), then it would be computationally feasible to explore its interaction with 
associativity, and would suggest that the Reynolds operator belongs to a "higher order" class. 
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system induced by <f>, the Grobner-Shirshov bases of the operated ideal induced by <p, and the 
free operated algebras satisfying 0. In Section 6, we define similarly operators and operated 
algebras of Rota-Baxter type and give a conjecture for the complete list of Rota-Baxter type 
OPIs. In Section 7, we give a description of an empirical Mathematica program by which we 
obtained the lists. In the final Section 8, we explain our approach in the context of varieties 
of algebras, providing research directions towards a further understanding of Rota's Problem, 
leading possibly to new tools and theoretical proofs of our conjectures. 



2. Operator identities 



In this section we give a precise definition of an OPI in the framework of operated algebras j^j 
We review the concept of operated (associative) monoids, operated algebras, and bracketed 
words, followed by a construction for the free operated monoids and algebras using bracketed 



words. Bracketed words are related to Motzkin words and decorated rooted trees (Guo, 2009) 



2.1. Operated monoids and algebras 

Definition 2.1. An operated monoid^] is a monoid U together with a map P : U — > U. A 

morphism from an operated monoid U to an operated monoid V is a monoid homomorphism 
/ : U — > V such that / o P = P o /, that is, the diagram below is commutative: 




Let k be a commutative unitary ring. In Definition 2.1, we may replace "monoid" by "semi- 
group," "k-algebra," or "nonunitary k-algebra" to define^ operated semigroup, operated k- 
algebra and operated nonunitary k-algebra, respectively. For example, the semigroup 2r of 
rooted forests, with the concatenation product and the grafting map |_ J, turns into an operated 



semigroup (Guo, 2009). The k-module k J generated by 5F is an operated nonunitary k-algebra. 
The unitarization of this algebra has appeared in the work of Connes and Kreimei ( 1998 ) on 
renormalization of quantum field theory. 

The adjoint functor of the forgetful functor from the category of operated monoids to the 
category of sets gives the free operated monoids in the usual way. More precisely, a free operated 
monoid on a set X is an operated monoid U together with a map j : X — » U with the property 
that, for any operated monoid V together with a map f : X —* V, there is a unique morphism 
/:£/—> V of operated monoids such that / = / ° j. Any two free operated monoid on the same 
set X are isomorphic via a unique isomorphism. 



The c oncepts, construction of free ob jec t s and 



algebra (Bums and Sankappanavai 



1981 



[Colin 



esults i 



1991 



l this section are cov e red in more generality in texts on universal 



Baader and Nipkow, 1998). Our review makes this paper more 



accessible and allows us to establish our own notations. 

7 As remarked in Footnote 3, we use the same symbol P for all distinguished maps and hence we shall simply use U for 
an operated monoid. In this paper, all semigroups and monoids are associative but generally non-commutative. 

8 To adapt Definition 2. 1 for operated k-algebra categories, P is assumed to be a k-linear map and / is a morphism of 
the underlying k-algebras. 



5 



We similarly define the notion of a free operated (nonunitary) k-algebra on a set X. As shown 
in Guo (2009), the operated non-unitary k-algebra of rooted forests mentioned above is the free 
operated non-unitary k-algebra on one generator. 

An operated ideal in an operated k-algebra R is an ideal closed under the operator. The 
operated ideal generated by a set O c R is the smallest operated ideal in R containing <J>. 

2.2. Free operated monoids 

For any set Y, let M(Y) be the free monoid generated by Y and let [Y] be the set {[y] | y e Y], 
which is just another copy of Y whose elements are denoted by \y\ for distinction. 

We now construct the free operated monoid over a given set X as the limit of a directed system 

of free monoids 9Tt„, where the transition morphisms i„ will be natural embeddings. For this 
purpose, let Mo = M{X), and let 

mix := M(XL) |9Jt J)- 

Let to be the natural embedding to : 9Jlo 971 1 ■ Note that elements in [M(X)] are only symbols 
indexed by elements in M(X). Thus, while 1 e SOTo is identified with t (l) = 1 e SJti, |1J e SJti 
is not the identity. 

Assuming by induction that for some n ^ 2, we have defined the free monoids 9J?,, ^ ; ^ 
n — 1, and the embedding t,_2 : 9H/-2 — > SJlj-i, ^ i ^ n — 2. Let 

0Jl n (X):=M(XuL9Jl n -iJ). (10) 
The identity map on X and the embedding t„_2 induce an injection 

£„_i :XULOT„-2J ^XUL»l„-iJ, (11) 
which, by the functoriality of M, extends to an embedding (still denoted by i„_i) of free monoids 

t„_! : OHn-i = M(X U LOT„- 2 J) ^ M(X U LlOT^iJ) = (12) 
This completes the construction of the directed system. Finally we define the monoi d0»t(X)by 



PU = TVX) ■= limOT,, = (J JOT,, 



where the identity of UX[J is (the directed limit of) 1. 



Theorem 2.2. ( |Guo| ( |2009| ), Corollaries 3.6 and 3.7) 

(1) The monoid \\X\\, with operator P := |_ J and natural embedding j : X — > [|X[J, is the free 
operated monoid on X. 

(2) The unitary (associative) k-algebra k\\X\\, with the k-linear operator P induced by [ J and 
the natural embedding j : X — > kpf|], is the free operated unitary k-algebra on X. 



9 We adopt two notations for the free operated monoid on X. The notation suggested by a reviewer, is simpler and 
more natural, but 2Jt(X) is consistent with prior literature and occasionally, typographically more pleasing, as in L9Jt(X)J, 
when compared to LU-^UJ - 
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Definition 2.3. An element w e \\X\\ is called a bracketed word on the generator set X. If 

X = [xi, . . . , Xk), we also write k[]X|] simply as k|]xi, . . . , ^U- An element <p e k[]X|] but not in k 
is called a bracketed polynomial in X. 

A nonunit element w of \\X\\ = can be uniquely expressed in the form 

w = w\ ■ • - Wk for some k and some w, e X U UStPOJ, 1 ^ i ^ k. (13) 

Definition 2.4. For a nonunit element w e \\X\\ - 9Ji(X), the decomposition in Eq. (13) is called 
the standard decomposition of w and elements in X U LSDt(X)J are called indecomposable. The 
integer |w| := k is called the breadth of w. The integer d(w) := min{« | w e 9Jl„] is called the 
depth of w. We also consider 1 (the empty product in \\X]\ and Eq. (13)) to be indecomposable 
and define |(|1) = d(V) = 0. 



Remark 2.5. Alternatively ( puc| , |2009| ), \\X\\ can be viewed as the set of bracketed words w of 



the free monoid M(X U {[, J}) generated by X U {[, J}, in which the brackets [ J form balanced 
pairs, or more explicitly, 

(1) the total number of [ in the word w equals to the total number of J in w; and 

(2) counting from the left to the right of w, the number of [ is always greater than or equal to 
the number of J. 

For example, for the set X = [x], the element w := Lx_W*WJ is a bracketed word in 
M({x, L, J}), with \w\ = 3 and d(w) = 2, while neither |_|xj (failing the first condition) nor J.^L 
(failing the second condition) is. 

2.3. Operated polynomial identity algebras 

We recall the concept of a polynomial identity algebra. Let k(X) be the free non-commutative 
k-algebra on a finite set X = {xi, . . . ,Xk). A given <p 6 k(X), 0^0, defines a category Alg^ 
of algebras, whose objects are k-algebras R satisfying 4>{r\, . . . , r^) = for all r\, . . . , e R. 
The non-commutative polynomial (f> (formally, the equation (p(x\, . . . , Xk) = 0, or its equivalent 
4>\{x\, . . . , x^ = <pi(x\, . . . , Xk) if (f> := 0i - (pi) is classically called a polynomial identity (PI) 
and we say R is a Pi-algebra if R satisfies 4> for some 0. For any set Z, we may define the free 
Pi-algebra on Z in Alg^ by the obvious universal property. 

We extend this notion to operated algebras. Let <p 6 k|]xi , ■ • • , XkW, let R be an operated algebra, 
and let r = . . . , r^) € R k . The substitution map f r : {x\ , . . . , Xk] — > R that maps x,- to r,- induces 
a unique morphism f r : k[]xi ,.. .,XkW — > R of operated algebras that extends f r . Let 0« : R k — > R 
be defined by 

4> R (r u ...,r k ) :=M4>(x u ...,Xk)). (14) 

Definition 2.6. Let <p e kU^i, • • • , XkW and R be an operated algebra. If 

fain, . . . ,r k ) = 0, Vr u ...,r k €R, 

then R is called a 0-algebra, the operator P defining R is called a 0-operator, and <p (or (p = 0) 
is called an operated polynomial identity (OPI). An operated polynomial identity algebra or 

an OPI-algebra is a 0-algebra for some <f> e k[]xi ,.. .,Xk\\ for some positive integer k. 
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Example 2.7. When <f> :- \_xy\ - x\y} - [x\y, then a ^-operator on a k-algebra R is a derivation 
on R, usually denoted by S, and R is an ordinary, possibly non-commutative, differential algebra 
in which 6(a) = for all a e k. 

Example 2.8. When (f> := L^JIjJ - L-^LyJJ _ LIaM _ ^LxyJ> where A e k, then a 0-operator (resp. 
0-algebra) is a Rota-Baxter operator (resp. Rota-Baxter algebra) of weight A. We denote such 
operators by P. 

Example 2.9. When tp is from the noncommutative polynomial algebra k(X), then a </>-algebra 
is an algebra with polynomial identity, which we may view as an operated algebra where the 
operator is the identity map. 

The next proposition is a consequence of the universal property of free operated algebras 
and can be regarded as a special case of a very general result on O-algebras, where Q is a set 
called the signature and Q, represents a family of operations on the algebra (see e.g. Zohn| , 1991 



Chapter I, Proposition 3.6). We caution the reader that there are two sets involved: the set X in 
terms of which an OPI is expressed, and the set Z on which the free 0-algebra is constructed. 



Proposition 2.10. ( paader and Nipkowj ( |1998j ), Theorem 3.5.6) Let Z be a set, Jet R = k[]ZU, 
and let jz : Z — > R be the natural embedding. LetX = [x\, . . . ,Xk] and (f> e k\\X]\. Let(pR : R k — > R 
be as defined in Eq. (14), Jet /^(Z) be the operated ideal ofR generated by the set 

{fain,. . .,r k ) I n,...,n e R}, 

and let : R — » R/I^Z) be the quotient morphism. Let 

i z := 7!> o j z : Z -» R/I^(Z). 

Then the quotient operated algebra RjI$(Z), together with iz and the operator P induced by [J, 
is the free ^-algebra on Z. 



For a specific proof of Proposition 2.10, see Guo, Sit and Zhang (2011). Proposition 2.10 
shows that for any non-zero <p e k|]X|j, there is always a (free, associative, but perhaps trivial) 
0-algebra. Thus the "formulation" below of Rota's Problem would not be helpful. 

Find all non-zero <p e k|JXl] such that the OPI (f> — can be satisfied by some linear 
operator on some associative algebra. 

While the construction in Proposition 2.10 is general, we note that the free 0-algebra may 
have hidden consequences. 

Example 2.11. Let (p(x,y) := |xyj - y\_x\. Let Z be a set and let Q = k[JZ[J/7^(Z) be the free 
0-algebra with the operator P induced by [J on R = k|]Zl]. Let a,b,c 6 Q be arbitrary. We 
must have P((ab)c) = P{a(bc)). Applying the identity (p = on Q to both sides, we find that 
(be - cb)P(a) — 0. We do not know if I^Z) is completely primeT^] or not, but if it is, then we 
would have two possibilities: Q is commutative, or Q is not commutative but P(a) = for all 
a E Q. We also note that any commutative algebra with the identity as operator is a 0-algebra. 



10 Recall that there are two notions of primeness for an ideal / of a not-necessarily commutative ring R: I (I j= R) is 
completely prime if uv e / for u, v £ R implies that either u e / or v e /; and / is prime if for any ideals U and V, UV c / 
implies either U c / or V c /. When R is commutative, the two definitions are equivalent. 
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3. Grobner-Shirshov bases for free operated algebras 

We now introduce the framework of Grob ner-Shirshov ba ses for the f ree operat e d algeb ra 
kPU on X. Shirshov basis was first studied by Zhukov ( 195C| ) and then by Shirshov ( 1962a ,b|). 
For a historic review, we refer the reader to the Introduction and Bibliography sections of Bokut, 
Chen, and Qiu (201C), who gave a good survey of methods to construct linear bases, and in 



particular, Grobner-Shirshov bases, in algebras under various combinations of commutativity and 
associativity. Dotsenko and Khoroshkirj ( 2010 ) has further details on t he relation s hip of Grobner- 
Shirshov bases with the well-kn own work of Buchberger ( 1965 ) and Bergman ( 1978 ). We also 
pr ovided a sketchy summary in Guo and Sit (2010). Recently, these bases have been obtained 
by Bokut, Chen, and Qiu ( 201C ) for free nonunitary operated algebras. We will consider the case 
of free unitary operated algebras. 
With the notation in 



Bokut, Chen, and Qiu (2010), let k(X;Q) denote the free nonunitary 



associative algebra on X with a set Q of linear operators. When Q consists only of one unary 
operator |_ J, k(X; Q) is the non-unitary version of k[]X|] and may be constructed as k©, where 

© = lim©„ 

with &„ defined recursively by 

6 n :=S(XUL6„_iJ), e :=S(X), 

and where, for any set Y, S (Y) is the semigroup generated by Y. 

As is well-known, the difference between an associative algebra A and its unitarization A is 
very simple: A — A ffik 1. For an operated algebra, the difference is much more significant, as we 
can already see from their constructions. Since we are studying operat ors on unitary algebras, 
we need to be careful adapting results from Bokut, Chen, and Qiu ( 201C ). For this reason and for 
introducing notation, we establish here some results that will lead to the Composition-Diamond 
Lemma (Theorem 3.13) and construction of Grobner-Shirshov bases for unitary operated alge- 
bras. 

Definition 3.1. Let ★ be a symbol not in X and let X* = X U {★}. By a ★-bracketed word on 

X, we mean any expression in P*|j with exactly one occurrence of ★. The set of all ★ -bracketed 
words on X is denoted by For q e and u e we define 



q\ u ■= qU 



(15) 



to be the bracketed word obtained by replacing the letter ★ in q by u, and call q\ u a M-bracketed 
word on X. Further, for s = 2; c\U\ e k[]X|J, where c,- E k and m,- e \\X\\, an d q e PU*> we define 



q\s ■= ^c,<7k 



(16) 



and extend by linearity to define the symbol q\ s for any q e k|]X|]*. Note that q\ s is in general not 
a bracketed word but a bracketed polynomial. 



This process is the same as the process of replacing subterms in ftaader and Nipkow (1998, 
Definition 3.1.3). We note the following simple relationship between operator replacement and 
ideal generation. 

Lemma 3.2. Let S be a subset of k[]X|j. Let ld(S) be the operated ideal of k|]X|] generated by 
S . Then 

ld(S) = Ciqi\ s . | ct E k, q-, e PIT, s, ; £ S, 1 < i < k, k > 1 
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Proof. It is clear that the right hand side is contained in the left hand side. On the other hand, the 
right hand side is already an operated ideal of k[]X|J that contains S . □ 

Definition 3.3. For distinct symbols *i,*2 not in X, let X* 1 '* 2 = X U {*i,*2l- We define a 
*2)-bracketed word on X to be a bracketed word in |]X*''* 2 U with exactly one occurrence 
of *i and exactly one occurrence of *2- The set of (*i, -^-bracketed words on X is denoted by 
PU* 1 -* 2 . For q E PU* 1 '* 2 and m,u 2 £ k||X[|, we define 

(17) 

to be the bracketed word obtained by replacing the letter *i (resp. *2) in q by u\ (resp. 112) and 
call it a (ui, W2)-bracketed word on X. 

A (wi, M2)-bracketed word on X can also be recursively defined by 

q\ UUU2 := (q M \ ul )\ U2 , (18) 

where q* 1 is g when q is regarded as a *i-bracketed word on the set X* 2 . Then is in \\X^* 2 
and we can apply Eq. (15). Similarly, treating q first as a *2-bracketed word q* 2 on the set X*', 
we have 

9k* := (9* 2 L 2 )k (19) 

Definition 3.4. A monomial ordering on is a well-ordering ^ on UX[] satisfying the two 
conditions: 

U«; u<v=>q\ u <q\ v , for all w, v 6 PHI and all # e PH*. (20) 

Here, as usual, we denote u < v if u v but u + v. Given a monomial ordering ^ and a 
bracketed polynomial 5 e k|]X[], we let 5 denote the leading bracketed word (monomial) of s. If 
the coefficient of s in s is 1, we call s monic with respect to the monomial order < . 

Examples of such orderings will be considered later in this paper. For now, we fix a monomial 
ordering ^ on \\X\\. 

Lemma 3.5. Let s, s' e k[|X[J, let f e [|X[J and suppose s < t. Then 

(1) For any q e P^** we have q\ s = q\j < q\ t . 

(2) For<? e PHI* 1 '* 2 , we have 



q\s,s> = qh,s> = 9l s ,7 = 9b,7 < 9l,,7 an d q\s>, s < q\ 7j . 

Proof. (1) Let s = a i' s i where ^ a, e k and s,- e [|X[J with «i > ■ • ■ > s^. Thus I = si. 
By definition, g| s = 2/=i fl /9U an d by Eq. (20) for a monomial order, q\ Si > ■■■ > q\ Sk . Thus 
q\s - q\si = <?ls- The inequality follows by the property in Eq. (20) of a monomial order. 

(2) Let s = 2ti OiSi e k\\X\\ be as in Part (1). Thus s = si . By Eq. (18) and Part (1), we have 



q\ Si , s > = (9*'U)I S ' = (9* 1 !.,)!- = 9 fl ,7. (1 < K *). (21) 
By Eq. (19) and the property in Eq. (20) of a monomial order, we have 

9l Sl , 7 = (9* 2 l7)U>-->(9* 2 l F )U = 9U,7. (22) 
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It follows from Eqs. (21) and (22) that q\ SuS ' > ■■■ > q\s k ,s' and since by linearity, q\ StS > 
Hii fl tfk s'> we have 



q\ s<s > = max{^| SijJ , | 1 s$ ; $C = q\ SuS , = q\ Su7 = q\--. (23) 

The first equality in Part (2) follows by replacing s with s in Eq. (23), and the second by replacing 
s' with s'. By the equalities just proved and Eq. (19), we have 



q\s,s' = q\i,~ = (q* 2 \-)h < (q* 2 \-)\t = q\ u ~- 
The other inequality follows similarly. □ 

The follow ing concepts of intersection and including compositions are adapted from B okut, 
Chen, and Qiu ( |201C| ). For operated algebras, they are a nalogous t o the c oncepts of overlap and 



inclusion S -polynomials for associative algebras, as in Bergman ( 1978 ). Here we pay careful 
attention to ensure these concepts are well-defined. 

Definition 3.6. Let k|]X[] be two bracketed polynomials monic with respect to SC. 

(1) If there exist //, y, w 6 \\X^ suc h that w — f[i = vg with |w| < \f \ + \g\, then we define 

(f,g)w ■= (f,gt? -=fM-V8 
and call it the intersection composition of / and g with respect to (p., v). 

(2) If there exist a q e p^* and w E \\X\\ such that w = / = q\j, then we define 

if,g)%-=f-q\g 
and call it an including composition of / and g with respect to q. 

Remark 3.7. We note that the superscripts fi, v for the intersection composition (/, g)^ v is not 
necessary, since fi and v are uniquely defined by w, indeed, by \w\, because of the uniqueness of 
the standard decompositions of /, fi, v, g. However, the superscript q in the including composition 
(f> g)t i s needed to ensure that the notation is well-defined. For example, if g occurs in / 
more than once, we might have two different </s that give the same q\^ but different including 
compositions. To illustrate, take / = xyx,g = x — 1 e k|]x,y|] an d <7i = *yx, qi — xy* 6 P'U*- 
Then we have 

xyx = w = f = qi\g=f = q 2 \g. 
But (/, g)% = f - q\ \ g = yx and (/, gf 2 = f - q 2 \ g = xy are not the same. 

Remark 3.8. If Definition 3.6(1) holds with n = 1, then the intersection composition is also an 
including composition. For if / = vg, then / = q\j where q = v*. Hence (/, g)h v = (f,g)l. 

However, if v = 1 but fi + 1, then since /u = g, there is no q e \\X\\* satisfying / = q\j. As 
should have been clear, Definition 3.6(2) is not symmetric with respect to / and g. 

Definition 3.9. Let S be a set of monic bracketed polynomials and let w e \\X\\. 

(1) For u, v e k\\X]\, we call u and v congruent modulo (S,w) and denote this by 

u = v mod (S, w) 

if u — v = 2; C ;<7;U> with c; e k, ^ e 6 S and q,\— < w. 

(2) For f,g€ k|JXU and suitable w,ju, v or q that give an intersection composition {f,g)»? or 
an including composition ( f,g) q w , the composition is called trivial modulo (S, w) if 

(ftgf/ or (f,g) 9 w = mod(5,w). 
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(3) The set S c kp^ is a Grobner-Shirshov basis if, for all f,g e S, all intersection 
compositions (/, g)fj v and all including compositions (f,g) q w are trivial modulo (S,w). 

Definition 3.10. (1) Let u, w be two bracketed words in We call u a subword of w if w 

is in the operated ideal of generated by u. In terms of *-words, u is a subword of w 
if there is a q e U^U* sucn that w = q\„. A subword u of w is a subword when viewed 
as a string in the free monoid M(X U {[, J}) as in Remark 2.5: namely the string of letters 
forming u is a substring of the string of letters forming w. 
(2) Let u\ and ui be two subwords of w. 

(a) u\ and u.2 are called separated if there is q e IJXU* 1 '* 2 such that w = q\ UUU2 ■ in terms of 
strings in M(X U {|_, J}), this means that the substrings u\ and U2 of w have no overlap. 

(b) u\ and «2 are called overlapping if there are subwords a,b,c of w such that au\ = 
c = U2b or au2 — c — u\b with \c\ < \u\\ + \uo\. In terms of strings in M(X U {[, J}), this 
means that the strings of u\ and u.2 have an overlap. 

We note there is a third relative location of u\ and 112 in w, namely either u\ or U2 is nested in 
(i.e., a subword of) the other. 

Proposition 3.11. Let S C k[|X[j. Let s\,S2 e S and suppose there exist q\,q2 e U^U* an d 
w e \\X\\ such that w = q\ |— = by which we may view ~, I2 as subwords of w and suppose 
as such, ~ and I2 are separated in w. Then qi\ Sl = q2\ Sl mod (S, w). 

Proof. Let q e IJXU* 1 '* 2 be the *2)-bracketed word obtained by replacing this occurrence of 
~s\ in w by *i and this occurrence of Jo in w by * 2 . Then we have 

q*'\— = qi, q* 2 \ir-qu and q\^ t -_ = gi|— = # 2 bj = w, 
where in the first two equalities, we have identified and IJXU* 1 with U^U*- Let 

Sl = Sl + V C/M/, S 2 = S2 + ^ rfjVj 

i 7 

where c,, t/y e k, m,, vy e \\X\\, and mJ = m ; < sT and vj = Vy < si". Then by the linearity of si, S2 in 
q\s uSl , we have 

g>U - q\\ Sl = (q*'\ir)L ~ (<7*%)U 

— *2 _ ^1*1. ^2 

= (-*?!--, S 2 + tfU, S 2 ) + tel*!, -77 - #U, J 2 ) 

= -(9*'U-ir)U + (g* , U-K)U 

i ,/' 

Since m, = 77J and v/ = v], by Eqs. (18) and (19), we have 

(<?*' U)|- = ^TTJ,— < g«,5 = w and (<?* 2 |, v )|- = q^,- < = w. 

This means 

9i Is, = qiL mod (5, w), 

completing the proof. □ 
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Lemma 3.12. Let ^ be a monomial ordering of k[]X[] and let S be a set of monic bracketed 
polynomials in k\\X\\. Then the following conditions on S are equivalent: 

(1) S is a Grobner-Shirshov basis. 

(2) For every si,s 2 e S and w e \\X\\ for which there exist q\,q 2 e such that w - q\\-^ = 
q 2 \—_, wehaveqi\ Sl = q 2 \ S2 mod(S,w). 

Proof. (2) => ( 1 ): This is clear since the congruences include those from intersection composition 
and inclusion composition. 

(1) => (2): Let s\,s 2 e S and w e \\X\\, and suppose there exist qi,q 2 e PU* sucn that 
w — q\\— = q 2 \^. We fix one such occurrence of Jf and one such occurrence of sjj. We distinguish 
three cases according to the relative location of these particular occurrences of Jj" and m w. 

EE 

Case I. Suppose the bracketed words s\ and 52 are separated in w. This case is Proposition 3.11. 

Case II. Suppose the bracketed words ~ and si" overlap in w. Then by switching si and s 2 if 
necessary, we might assume that there exist some bracketed subwords w\,fi, v, e \\X\\ of w such 
that w\ = J\p = VS2 with |wi| < | sTI + | si |. Thus there is p e pi* such that p\ Wx = p\—^ = w 
and then q\ = p\*^. Let q :- e PI]* 1 '* 2 be obtained from q\ by replacing ★ by *i and p 

by *2- Then we have 

q k \ = q\, q*'\v = qi, and p\- M = q\-^ = qi\— = w. 

where in the first two equalities, we have identified P|]* 2 and PU* 1 with PU*. Thus, we have 

q\\s x -q 2 \s 2 = (<?%)ln -(q*'\v)\ Sl = p\ sl n- VS2 - 

Since S is a Grobner-Shirshov basis, we have 

sip -vs 2 = Yj c iPi\'r 
where each Cj e k, pj e PU*, tj E S and pj\- < w\ . By linearity, 

q\l x -q 2 \s 2 =p\s 1 »-vs 1 = ^ cjP\ PJ \tj- 

By Lemma 3.5.1, pj\ tj = pj\j- < w\. Thus 



P\pj\,, = P\jT < P\m = Pkp =Hk = W. 

Therefore 

qi\s, = qiL mod (5, w). 

Case III. Suppose one of the bracketed words Tf, sj is a subword of the other. Without loss 
of generality, suppose = q\j^ for some ^-bracketed word q. Then we have an inclusion 
composition (si , s 2 )— . 



" We note that there might be multiple occurrences of Jf and/or ~s% in w, with different relative locations. If so, then we 
need to consider each of them separately. For example, take si = ab, S2 - be and w = abcabc. Then ~s\ = ab and I2 = ba 
both appear twice in w, as shown below. 

1 2 

w = ab c ab c = a be a be . 
1 2 

Then we need to consider the four (pairs of) occurrences of ~S\ and in w, two of which are separated and two of which 
overlap. 
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Since 5 is a Grobner-Shirshov basis, we have 

(si, -52)- = si - q\ S2 = 2^ CjPjltj, 
j 

with Cj e k, pj e P^*, 6 ^ anc ^ Pj^F < *T- Then 

w = <72br = qihr = qi\g^ = tfil,^ = /%, (24) 

where /;> e is obtained from q\ by replacing ★ with q. 

Now 5 is a Grobner-Shirshov basis. Hence we may write, by Case II that has been proved and 
in which we take q\ - p and s\ = S2, 

I 

where dj e k, r,- e p"[]* and v,- e 5 and r,| v . < w. Hence 
qi\s 2 - qi\ Sj =P\s 2 - 2 ^ r 'lv> ~~ 9i\s, 

i 

= qi\q\, 2 -QiU -^drAvi 

i 

= -qi\st-q\ 12 ~Yj d i r ^i 
i 

= -Y i c j4i\ph-Y i d irt\v, 

j i 

= ~2^ c Mi\pi)\tj - 2^ d ' r '^- 
j 

Now tj is in S and 

(qi\ Pj )\tj = qilpjkj < qik = w - 

Thus, we obtain <72ls, _ <?ilsi s0mod(5,w). □ 

The following version of Compo sition-Diamond lemma can also be proved by the same 
argument as its nonunitary analogue (Bokut, Chen, and Qiu, 201C, Theorem 3.2). 

Theorem 3.13. (Composition-Diamond lemma) Let S be a set of monic bracketed polynomials 
in kUXy, > a monomial ordering on and ld(S) the operated ideal of k\\X\\ generated by S . 
Then the following statements are equivalent: 

(1) S is a Grobner-Shirshov basis in k[|X||. 

(2) Iff + is in Id(S), then f = q\- s for some q e PIT and s e S . 

(3) Iff + is in Id(5), then 

f = Ciqi\sj + c 2 q2\ S2 + ■■■ + c„q„\ Sn , (25) 

where c; € k, s t e S, q, e Pfl|*, tfitar > "?2|— > ■ ■ ■> q n \i;- 

(4) kUZU = klrr(5)eld(5) where 



Irr(S):= PU\ { q\i\ q e PIT, s e S j 
and Irr(5) is a k-basis of k[|X[|/Id(5). 
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Before providing its proof, we give the following immediate corollary of the theorem. 

Corollary 3.14. Let / be an operated ideal of k[|X[J. If / has a generating set S that is a Grobner- 
Shirshov basis, then Irr(S) is a k-basis of k|JX|J//. 

Proof. (1) => (2) Let * f e U(S). Then by Lemma 3.2, / is of the form 

k 

f = Y j c i q i \ Si , 0^c i ek,q i em*(X),s i eS,l^i^k. (26) 
i=i 

Let w, = qi\—. We rearrange them in non-increasing order by 

Wl = W 2 = • • • = W m > W,„+i > • • • > Wjfc. 

If for each + f e Id(5 ) there is a choice of the above sum such that m = 1 , then f - q x \^ and 
we are done. So suppose the implication (1) ==> (2) does not hold. Then there is + f e ld(S) 
such that for any expression in Eq. (26), we have m ^ 2. Fix such an / and choose an expression 
in Eq. (26) such that w\ = is minimal and such that m is minimal for this choice of w\, that 
is, with the fewest q,\ Si such that q/\— = q\\— . Since m ^ 2, we have q\\— = w\ — wi — qi\—- 

Since S is a Grobner-Shirshov basis in k|JXl], by Lemma 3.12, we have 

qiU -qiU =J_ J djp j \r J 

i 

where dj e k, rj e S,pj 6 U^U* an d Pj\~ < w i- Thus 

k 

1=1 

= (ci + c 2 )^i| Sl + c 3 ^ 3 | j3 + • ■ • + c m q m \ Sm + 2^ c i c JiU + X ddjPjlj. 

i=m+l j 

By the minimality of m, we must have c\ + C2 = c 3 = • • • = c m =0. We then obtain an 
expression of / in the form of Eq. (26) for which q t \— is even smaller. This is a contradiction. 

(2) => (3). Suppose the implication does not hold. Let F be the set of counterexamples, namely 
those + f 6 Id(5) that cannot be written in the form of Eq. (25). Then the set {f\f e F] of 
leading terms is not empty. Then there is an / such that / is minimal in this set. By Item (2), 
there are q e \\X\\* and s e S such that / = q\j. Since / is in F and q\ s is not in F, f — q\ s is not 
zero. But / - q\ s — f - q\j — means that / - q\ s is less than /. By the minimality of / in F, 
f - q\ s + is not in F and hence can be written in the form of Eq. (25). But this means that / 
can also be written in the form of Eq. (25). This is a contradiction. 

(3) => (4). Obviously e klrr(S) + ld(S) Q k\\X^. Suppose the inclusion is proper. Then 
kP[]\(kIrr(S) + W)) contains only nonzero elements. Let / e k|]Z[]\(kIrr(S) + Id(5)) be such 
that 

/ = min{£|s e kPU\(kIrr(S) + Id(S)) }. (27) 
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Suppose / is in Irr(5), then / + f since / t Irr(5). So * f - f is in k||Z|l\(kIrr(S) + U(S)) 

with /-/</. This is a contradiction. But suppose / is not in Irr(5'). Then / = q\j for some 
q e |JZ|J* and s e S . Then / — q\ s < f. If / = then / is in Ides'), a contradiction. Thus 
/ + q\ s - Then + f — q\ s with / - q\ s < f. By the minimality of / in Eq. (27), we see that 
f — q\ s e klrr^) + Id(S) and hence also / e kln(S) + Id(S), again a contradiction. Therefore, 
k[]Z[] = klrr(5)+ld(5). 

Suppose klrr(S) n Id(5) + and let * f e klrr(S) n Id(S). Then / = c\V X + ■ ■ ■ + c k v k 
with v\ > ■ ■ ■ > v k € Irr(S). Then by / € ld(S) and Part (3), / = V\ is of the form q\- for some 
q 6 UZy* and s 6 S . This is a contradiction to the construction of In^S) . 

Therefore, k|]ZU = klrr(S) © Id(5) and hence Irr(5) is a basis of k|]Z[]/Id(S). 

(4) => (1). We first prove a lemma. 

Lemma 3.15. Suppose Item (4) holds. Let + h e ld(S) and let w e \\Z\\ such that w > h. Then 
h = Zjdjqjlsj with qj\- < w. 

Proof. Denote 

Lead(5):={^|-|^eUZU*,ie5}. 
Then by Item (4), we have the disjoint union |]ZU = Lead(5 ) U ln(S ). Then for + h e ld(S ), we 
can write 

h — c\U\ + • • • + CkUk 

in which u\ > ■ ■ ■ > u k e [JZU and there is 1 ^ ;'o ^ k such that m, e Lead(5) and all the previous 
terms, if there are any, are in Irr(S). We call m, the first monomial of h in Lead(S). Suppose the 
conclusion of the lemma does not hold. Then we can choose our counter example h such that the 
first monomial m, of h is minimal with respect to the order < . Then we have m, = q\- for some 
s e S . Consider 

ti := h - q\ s = c\U\ +■■■ + c, _im, _! + c, <?7-. s + c, 0+ im, 0+1 + • • • + c k u k . 

Then we still have h' < w. Since h is a counter example, h' + 0. Since q\ s is in Id(5'), h' is still in 
Id(5). Since 

qh-s = q\=^<q\i = u io , 

the first monomial of h' in Lead(S) is smaller than m, . By the minimality of h, we have h! = 
'Ejdjqjlsj with qj\JJ < w. Then h = h' + q\ s also has this property. This is a contradiction. □ 

Now suppose f,geS give a composition. Let F — ffi and G = vg in the case of intersection 
composition and let F — f and G = g| ? in the case of including composition. Then we have 
w := F = G. If (f,g) w = F — G = 0, then there is nothing to prove. If {f,g) w + 0, then by 
Lemma 3.15, there are ^ € []^U* and Sj e 5 such that (f,g) w = ^jdjqj\ Sj . with qj\— < w. Hence 
if, g)w is trivial modulo (S,w). □ 

4. Differential type operators 

As remarked in the Introduction, we restrict our attention to those OPIs that are computa- 
tionally feasible, in particular, to two families that are broad enough to include all the operators 
in Rota's list, except the Reynolds operator. These families are identified by how they behave 
with respect to multiplication for which associativity is assumed. As differentiation is easier than 
integration, we progress more on differential type OPIs than on Rota-Baxter type ones. 
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4.1. Concepts and conjecture 



Our model for differential type operators is the free differential algebra and its weighted 



generalization as considered in Guo and Keighei (2008). We refer the reader there for further 



details on construction of free (noncommutative) differential algebras of weight A. 
4.1.1. The concepts 

The known OPIs that define an endomorphism operator, a differential operator, or a differential 
operator of weight A share a common pattern, based on which we will define OPIs of differential 
type. For this family of operators, we shall use the prefix notation 6(r) (or 6r) for the image of r 
in such an algebra, which is more traditional, but we shall continue to use the infix notation |rj 
in k|]X[] to emphasize the string nature of bracketed expressions. 

Definition 4.1. We say an expression E(X) e k|]X|] is in differentially reduced form (DRF) if 
it does not contain any subexpression of the form \ uv\ for any non-units u, v e k[]Xy. Let £ be a 



rewriting system Baader and Nipkow ( 1998) in k[]X[]. We say E(X) is E-reducible if E(X) can 



be reduced to zero under 2. 

Let a set X be given. Define x (n) € n ^ 0, recursively by 

Then 

A(X) := {x (n) \xeX,n ^ 0), (28) 

generates a monoid M(A(X)) in and hence k(A(X)) := kM(A(X)) (the noncommutative 
differential polynomial ring) is a subalgebra of kPHJ. Then E(X) e kUXU is in DRF if and only if 
it is in k<A(X)>. 

Definition 4.2. Let <f>(x,y) := |xyj - N(x,y) e k\\x,y\\. 

(1) Define an associated rewriting system 

E := {[abi i — > N(a,b) \ a,b e Tt(Z)\{l}}, (29) 

where Z is a set. More precisely, for g, g' e k[|Z[j, denote g — g' if there are q e 9Jt*(Z) 
and a, b e SDT(Z) such that 

(a) Q'lLaij is a monomial of g with coefficient c ^ 0, 

(b) g' =g~ Cq\(lab\-N(a,b))- 

In other words, g' is obtained from g by replacing a subword [ab\ in a monomial of g by 
AT(a,fc). 

(2) An expression E(a, b) e k|]Z[] is differentially ^-reducible if it is Z^-reducible. 

The non-unit requirement in Eq. (29) is to avoid infinite rewriting of the form such as \ u\ = 
[u ■ 1J h> N{u, 1), when N(u, 1) may involve [u]. See Section 5 for this rewriting system in terms 
of reduction relations. 

Definition 4.3. We say an OPI if> e k\\x,y\\, or the expression cf> = 0, is of differential type 
(OPIDT) if <p has the form \ xy\ - N{x,y), where N(x,y) satisfies the three conditions: 
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(1) N(x,y) is totally linear in x and y, in the sense that the total degree of [x\'\ n (resp. 
[xl",n ^ 0) in each monomial of N(x,y) is one; 

(2) JV(jt,;y)isinDRF; 

(3) For any set Z and u, v, w e !Jt(Z)\{l}, N(uv, w) - N(u, vw) is differentially 0-reducible. 

If <p '■= Yxy\ - N(x,y) is an OPIDT, we also say the expression N(x,y) and the defining operator 
P of a 0-algebra R are of differential type. 

Remark 4.4. Condition 1 is imposed since we are only interested in linear operators. Condition 
2 is needed to avoid infinite rewriting under S^. Condition 3 is needed so that \_{uv)w\ — \_u(vw)]. 
Note that Condition 3 is not equivalent to 

<pkm( uv ' w ) ~ ^kuzyO, vw) 6 I<t,({Z}) V u, v, w € k|JZU, 
which is always true. Here /^({Z}) is the operated ideal o/k|]Z|] generated by the set 

{0k M (a,fc)|a,fcekUZ[|}. 

Example 4.5. ForanyA € k, the expressions Axy, A[x][y] (operators that are semi-endomorphisms), 
and A\y\\_x\ (operators that are semi-antimorphisms) are of differential type. A differential oper- 
ator of weight A satisfies an OPI of differential type (Eq. (9)). This can be easily verified. 

4.1.2. The OPIDT conjecture 

We can now state the classification problem of differential type OPIs and operators 

Problem 4.6. (Rota's Problem: the Differential Case) Find all operated polynomial identities 
of differential type by finding all expressions N(x,y) € k|]x, y[] of differential type. 

We propose the following answer to this problem. 

Conjecture 4.7. (OPIs of Differential Type) Let k be a field of characteristic zero. Every 
expression N(x,y) e k|Jx,y|J of differential type takes one (or more) of the forms below for 
some a, b, c, e e k : 

(1) 4>(jc|jJ + \_x\y) + cLxJLxl + exy where b 2 = b + ce, 

(2) ce 2 yx + exy + c[y]lx] - ce(y[x] + Lyjx), 

(3) 2 a u LlJ'-xyLl-K with the convention that |_1J° = 1. 

(4) x[y} + lx}y + ax[liy + bxy, 

(5) L*Jy + a(*LiJy-*yLU), 

(6) x\y\+a(x\_l]y-ll}xy). 

Note that the list is not symmetric in x and y. One might think that if N(x, y) is of differential 
type, then so is N(y, x). But this is not true. 

Example 4.8. N\(x,y) :- x[y] is of differential type since 

N\ (uv, w) - N\ (u, vw) — uv[wj - u[yw\ 

i— > mv[wJ — mv|_wJ = 

for all u, v, w € 97t(Z). However, N2(x,y) := y[x] is not, since 
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N2(xy, x) — Ni(u, vu) = u\uv\ — vu\u\ 

i— > uv\u\ — vu\u\ — (uv — vu)[u], 

which is in DRF (no further reduction using is possible, where <p :- [xy] - N2(x,y)) but 
non-zero. See also Example 2.11. 

4.2. Evidence for the conjecture 

We provide evidence, both computational and theoretical, for Conjecture 4.7. Further results 
will be given in Section 5. 

4.2.1. Verification of the operators 

Theorem 4.9. The OPI (f> := [xy] - N(x,y), where N{x,y) is any expression listed in Conjec- 
ture 4.7 is of differential type. 

Proof. Clearly, all six expressions are in DRF. We check 0-reducibility for the first two cases. 
Case 1. Here N(x,y) := fc(x[jj + l x ly) + cUJbd + exy, where b 2 - b + ce. We have 

cN(x,y) + bxy = {c\_x\ + bx){c\y\ + by). (30) 

Let a be the operator defined by a(u) :- c\u\ + bu for u e kUx,y[J. Then for any non-units 
m, v € kUx,yU, the rewriting rule \ uv\ i-» N(u, v) gives the rewriting rules 

aiuv) — c\uv\ + buv i-> cN(u, v) + buv — a(u)a(v) 

by Eq. (30). Again, by Eq. (30), for a non-unit w, we have 

cN(uv, w) + b{uv)w = a(uv)a(w) t-* (a(u)a(v))a(w), 
cN(u, vw) + bu(vw) — a(u)a(vw) t-> a(u)(a(v)a(w)). 

Then c(N(uv, w) - N(u, vw)) is differentially ^-reducible by associativity. If c + 0, then N{x, y) 
is of differential type. Suppose c = 0. The constraint b 2 = b + ce becomes b 2 = b and either 
b = or b = 1. When b = 0, <j> = [xy] - exy (semi-endomorphism case), and when b = 1, 
<p = [xy] - (x[yi + [x]y + exy). These are easily verified directly to be OPIs of differential type. 

Case 2. Here N(x,y) :- ce 2 yx + exy + c|jJLxJ - ce(y[xj + |_yjx) and we have N(x,y) - exy = 
c(lyi - ey){lx] - ex). Let a(u) = - eu and the rest of the proof is similar to Case 1. 

For the remaining cases, it is routine to check that N(uv, w) - N(u, vw) is differentially ir- 
reducible for (p := [xyj - N(x,y). For example, for Case 5, we have, using associativity, 

N(uv, w) — \_uv]w + a(uv\_l]w — uvw[l]) 

h- > (\_u]v + a(ull]v - mv[1J))vv + a(Mv|_lJw — mvw|_1J) 

= |_MJVW + fl(MLlJvW — MVW|_1J) 

= N(u, vw). 
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□ 



4.2.2. Computational evidence 

Definition 4.10. The operator degree of a monomial in k[]X[J is the total number that the 
operator |_ J appears in the monomial. The operator degree of a polynomial (p in k|]X[] is the 
maximum of the operator degrees of the monomials appearing in 0. 

Theorem 4.11. Let k be a field. The only expressions N{x,y) of differential type for which 
the total operator degrees ^ 2 are the ones listed in Conjecture 4.7. More precisely, the only 
expressions of differential type in the form 



N(x,y) := a fixy + a ,ix\y\ + ao,2*LlxlJ + «i,oUJy + WLvJ 

+auWLLyJJ + fl2,oLWJ3 ; + «2,iLUJJLyJ + a^LWJLLyJJ 

bo fi yx + foo.iyUJ + &o,£yLWJ + &i,o[jJ* + b^\\y\\_x\ 

+fei, 2 LyJLWJ + &2,oLLyJJ* + ^.iLWJW + HaLLyJJLWJ 

where a, y, b/j ek(0^ j ^ 2), are the ones listed. 



Proof. This is obtained and verified by computations in Mathematica Wolfram (2008). See 



Section 7 for a brief description and gig (g010|) for details and results. □ 



5. Relationship of differential type operators with convergent rewriting and Grobner- 
Shirshov bases 

We now characterize OPIDT in terms of convergent rewriting systems and Grobner-Shirshov 
bases as we have discussed in Section 3. We quote the following basic result of well order for 
reference. 

Lemma 5.1. (1 ) Let A and B be two sets with well-orderings. Then we obtain an extended 
well order on the disjoint union A U B by defining a < b for alia 6 A and b e B. 
(2) Let A be a set with a well order. Then the lexicographic order on M(A) is a well order. 

Let > be a well-ordering on a set Z. We extend > to a well-ordering on 97l(Z) = lim 9Jl„(Z) by 
recursively defining a well-ordering >„, on 9H„ := 2t„(Z) for each n ^ 0. Denote by deg z (t<) the 
number of x 6 Z in u with repetition. When n = 0, we have 9Jto = M(Z). In this case, we obtain a 
well-ordering by taking the lexicographic order >i ex on M(Z) induced by > with the convention 
that u >ie X 1 for all u € M(Z)\{1). Suppose > n has been defined on 9Jt„ := M(Z U L9JT«-iJ) for an 
n > 0. Then >„ induces 

(1) a well-ordering >' n on USWnJ by 

L«J >'„ LvJ ^ u >„ v; (31) 

(2) then a well-ordering >" on Z U \JSl„\ by Lemma 5.1.(1); 
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(3) then a well-ordering >,'," on Z U |_9JLJ by 

either deg (u) > deg (v) 
u > n v <=> < (32) 
[ or deg z («) = deg z (v) and u >" v. 

(4) then the lexicographic well-ordering > n+ \ on %R n +\ = M(Z U L^nJ) induced by >',". 

The orders >„ are compatible with the direct system {9Jt„}„^o an d hence induces a well-ordering, 
still denoted by >, on M(Z) = limOJt„. 

Example 5.2. Under this order, [xy] is greater than l,x,y and their iterated operations under |_ J. 
Thus |_jc_yj is the leading term for <p(x, y) = [xy] - N(x, y) when N(x, y) is in DRF, in particular, 
for those N(x,y) listed in Conjecture 4.7. 

Lemma 5.3. The order > on $}l(Z) is a monomial order. 

Proof. We prove by induction on « ^ the claim that for any q e 9Jt*(Z) n 9JT„(Z u {★}), u > v 
in 9Jt(Z) implies q\„ > q\ v . 

When « = 0, we have q e M(Z U {★)) in which ★ only appears once. Thus q = a ★ b with 
a, b e M(Z). Thus u > v in 9Jt(Z) implies that om^ > avb by the definition of lexicographic order. 

Suppose the claim has been proved for all q e 9Jt*(Z)n9Jt„(Zl_l{*}) for an « ^ 0. Consider^ e 
9Jt*(Z)n9JT, !+ i(Z □{*}). Then<? = apb with p € 9Jt*(Z)n9JT„ + i(Zl_l{*}) being indecomposable 
and a,b e 9Jt„+i(Z). Thus /? e Z is impossible. So we have p e |_9ftn(Z U {*})J. Then p = \_p' \ 
and p is in 9H*(Z) n dJl n (Z U {★}). Thus by the induction hypothesis, if u > v, then p'\ u > p'\ v . 
Then by Eq. (31), we also have p\ u > p\ v and hence q\ u > q\ v by the lexicographic order. This 
completes the induction. □ 

We next extend the concept of reduction relation from polynomial algebras k[Z] (Baader and 



Nipkow, [1998, Section 8.2) to operated polynomial algebras k|JZ[]. 



Definition 5.4. Let Z be a set and let < be a monomial well-ordering on 9Jt(Z). Let / € k|JZ[] 
be monic. We use / to define the following reduction relation — >/: For g,g' 6 k|]Z[], define 
g-*f g' if there is q e M*(Z) such that 

(1) q\j is a monomial of g with coefficient c, 

(2) g' = g-cq\ f . 

In other words, g' is obtained by replacing a subword / in a monomial of g by / - /. If F is a 
set of monic bracketed polynomials, we define 

->*•:= U /eF ->/ . 

We refer the reader to ftaader and Nipkow ( 1998) for concepts in rewriting systems, such as 
joinable and convergence. 

Proposition 5.5. Let Z be a set and let DJl(Z) be equipped with a monomial well- ordering <. 
Let F be a set of monic bracketed polynomials. Then the reduction relation — >p is a terminating 
relation. 



See (Baader and Nipkow 1998, Prop. 8.2.9) for the case of polynomials. 
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Proof. For each / € k|]Z|], let M(f) denote the set of monomials in /. Let > mu i denote the 
multiset order on the set M(£Dt(Z)) of finite multisets over 5D?(Z) induced by > on StJl(Z). Then 



by ( Baader and Nipkow , 1998 , Theorem 2.5.5), the order > mu i is terminating. Thus we just need 
to show that if g -> F g', then M(g) >„,„/ M(g'). If g —> F g', then there are / e F, q e 9Jl*(Z) 
such that q\j is a monomial of g with coefficient c + and such that g' — g - cq\ j. Since < is a 
monomial well order, all terms in q^_j are smaller than q\j. Thus M(g') is obtained from M{g) 
by replacing the monomial qh by smaller monomials. This implies M(g) >,„,,/ M(g'). □ 



We also prove the following variation of (Baader and Nipkow, 1998, Lemma 8.3.3) 



Lemma 5.6. Let /, g e k|]Z|]. If / - g is reduced to zero. Then / and g are joinable. 

Proof. We use induction on the number n of iterations of applying —*p to / - g to get zero. If 
n — 0, then / - g = and there is nothing to prove. Suppose the conclusion of the lemma holds 
with n ^ iterations and consider the case of « + 1 . Suppose the first reduction relation is — >y; for 
an fi € F by applying f to a monomial m and m appears in / (resp. g) with coefficient a (resp. 
b). So in = q\— for some q € SEJl*(Z). Then we obtain f — g —*f t h where 

h = (f-g)-{a- b)q\ fi = (f - aq\ fi ) - (g - bq\ fj ). 

Since h, that is the right hand side, is reduced to zero with n iterations of reductions, by the 
induction hypothesis, / - aq\f. and g - bq\/ j are joinable. Then it follows that / and g are 
joinable. □ 

Theorem 5.7. Let (f>(x,y) :- 8(xy) - N(x,y) e k|Jx,yU with N(x,y) in DRF and totally linear in 
x,y. The following statements are equivalent. 

(1) <p(x,y) is of differential type; 

(2) The rewriting system is convergent; 

(3) Let Z be a set with a well-ordering. With the order > in Eq. (32), the set 

S : = S : = {<j){u, v) = 5{uv) - N(u, v)| u, v e 9Jt(Z)\{l}} 

is a Grobner-Shirshov basis in k[]Z[J. 

(4) The free (p-algebra on a setZ is the noncommutative polynomial k-algebra k(A(Z)) where 
A(Z) is defined in Eq. (28), together with the operator d := dz on k(A(Z)) defined by the 
following recursion: 

Let u — U\u% - ■ ■ Uk e M(A(Z)), where u t 6 A(Z), 1 ^ i ^ k. 

(a) Ifk - 1, i.e., u = 6'(x) for some i ^ 0, x € Z, then dehned(u) = 5 l+l (x). 

(b) Ifk 1, then recursively define d(u) = N(u\,U2 ■ • • Uk). 

By Theorem 4.9, we have 

Corollary 5.8. Let N(x,y) be from the list in Conjecture 4.7. Then all the statements in Theo- 
rem 5.7 hold. 



When N(x,y) = xS(y) + 6(x)y + AS(x)8(y), we obtain flBokut, Chen, and Qiu| , |2010| , Theo- 
rem 5.1). 

Proof. (1) => (2) We first note that the rewriting system 2^ in Definition 4.2 is the same as the 
reduction relation — ^ with 

S := {0( M ,v)Kvekl|ZU}, 
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with the order in Eq. (32). Thus by Proposition 5.5, is terminating. Consequently, by (Baader 



and Nipkow, 1998, Lemma 2.7.2), to prove that is confluent and hence convergent, we just 
need to prove that is locally confluent. Suppose g[ x«— / — >x g2 for / € 5D?(Z) and gi,g2 e 
k|]Z[J. Then there are qi,qo € 3Jt*(Z) and Si,,$2 e S$(Z) such that 

?ibr = / = 9i\si, gi = qi\-- sr 82 = qih- S2 - 

Since s\ , S2 are in 5<^(Z), we can write 

Si = (p{u, v) = 5{uv) - N(u, v) = 5{uv) - ^ c,0,(m, v), 

i 

s 2 = 4>(r, s) = S(rs) - N(r, s) = 6(rs) - Y c,^(r, s), (33) 

i 

for some m, v,r,se 9Jt(Z)\{ 1 }. Here we have used the notation 

k 

N{x,y) = J] e^KJCy). e JOKx.y), 1 < i < k. 

i=l 

As in the proof of Lemma 3.12, there are three cases to consider. 

Case I. Suppose the bracketed words 7f and I2 are disjoint in /. Let q e 97t*''* 2 (X) be the 
(*i, *2)-bracketed word obtained by replacing this occurrence of ~s\ (resp. si) in / by *i (resp. 
★2)- Then we have 

/ = q\-,~_ = £1 Isr = 92 lii- 
Then we have 

?iU = 9U.S2. ?2l S2 = q , |-,s 2 - 

Hence 

Similarly, §2 >-% <7l.s,-ir,s 2 -37- This proves the local confluence. 

Case II. Suppose the bracketed words s7 and si have nonempty intersection in / but are not a 
proper subword of each other. Since 1i = 6(uv) and I2 = 5(rs) are indecomposable in 97t(Z), 
this is possible only when 6(uv) = S(rs). Thus uv = rs. Factoring each of u, v, r, s into standard 
decompositions, we see that there are a, b, c e 97l(Z) such that u = ab, v — c and r — a, s — be. 
Then we have ~s\ = 5{abc) — S2 and 

gi - g 2 = N(ab, c) - N(a, be). 
Since u,v,r,s + 1 , We have a, c + 1. If b = 1, then gi - gi is already zero. If b + 1 , then since 
(f> is of differential type, g\ - gi is reduced to zero. Then by Lemma 5.6, g\ and g2 are joinable. 

Case III. Suppose one of the bracketed words J\ and I2 is contained in the other. Without loss 
of generality, suppose JJ = q\— for some -^-bracketed word q e 9Jt*(Z). This means that 5(uv) = 
*T = <?bj = ?la(r.s)- Then g = (5(<7') for some ^-bracketed word q' and hence 5{uv) = q\s( rs ) = 
S(q'\g(rs))- This gives uv = q'\s(rs>- Since u, v e 9Jt(Z)\{l}, we have either q' = pv with p|a(,-.,) = u 
or g' = up with p|a(rj) = v, where p e 9Jt*(Z). Without loss of generality, suppose q' = pv with 
p\s(rs) = u - Then we have 

N(p\s(rs), v) = v) e /- 5{uv) = 5{p\ 6(rs) v) £(plw(r,*)v). 
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Using the notations in Eq. (33), we obtain 



N(p\s(rs), V) - S(p\N(r, s )V) = ^ Ci&CpU™), v) - ^ C,-tf(pl^( r>5 )V) 

i=l i=l 

A- A 

H Z 4 ^ C/0/(p|jV(r,s), V) - ^ CiN(p\^( r ,s), v) 



i=l i=l 
* A- A- A 

i=l 7=1 i=l 7=1 

= 

since the two double sums become the same after exchanging i and j. 

Note that iV(p|g(„), v) _ sT-si and 6( p\wr,s)v) = <?hj-s 2 ' We trien see tnat s i — *i an< ^ ?U-J4 are 
joinable by ( Baader and Nipkow , 1998| , Lemma 8.3.3). Then gi = qi\ Sl -jj and gn = q\\ q \ s = 
(<7il?)lj 2 -sl - ?2|jt-tt are joinable. This proves the local confluence in Case III and hence the 
proof of (~1 )=>(2).~ 

(2) => (3) Suppose is convergent. We prove that all compositions from S are trivial modulo 
(S,w). 

(The case of intersection compositions). By the definition of N(x, y) being in DRF, we have 



<P(x,y) = S(xy). 

Let two elements of S be given. They are of the form 

/:=0(m,v), g := 0(r, s), u,v,r,s e £DT(Z)\{1}. 

Hence / = 5(mv) and § = 5(rs). Suppose w - fp - vg gives an intersection composition, where 
p, v e PHJ. Since (|/|) = (|g|) = 1, we must have |w| < |/| + |g| = 2. Thus |w| = 1. This means that 
= |v| = 0. Since f,g are monic, we have p — v — 1. Thus w — f = g. That is, 6(uv) = 6(rs). 
Thus uv = rs. Factoring each of u, v, r, s into standard decompositions, we see that there are 
a,b,c e U^U such that u = ab, v - c and r — a, s — be. Therefore, / = (p(ab, c) and g = (p(a, be) 
is the only pair that gives intersection composition. Then we have w = / = 5(abc) = g and the 
resulting composition is 



if, g) w -=f-g= ~N{ab, c) + N(a, be). (34) 

Since N(ab, c) £ <— 5(abc) — >£ A^(a, fee) and X^ is confluent, we find that N(ab, c) and N(a, be) 
are joinable. Hence N(ab, c) - N(a, be) is reduced to zero. In particular, N(ab, c) - N(a, be) is 
in Id(5). Since <[>(ab,c) = d(abc) = (f>{a,bc), we have N(ab,c) < 5{abc) and N(a,bc) < d(abc). 
Thus N(ab, c) - N(a, be) is trivial modulo (S,6(abc)). 

(The cases of including compositions). On the other hand, / and g could only have the following 
including compositions: 
(1) If u = p\s(rs) for some p e 9Jt*(Z), then 

W : = / = l\g ~ d(P\5(rs)V), 

with q :- 6(pv). 
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(2) If v = p\s( rS ) for some p 6 9Jl*(Z), then 

w := f = q\g = S(up\ S (rs)), 

with q : = 6(up). 

So we just need to check that in both cases these compositions are trivial modulo (S,w). 
Consider the first case. Using the notation in Eq. (33), this composition is 



(f,g)w-=f-q\ g 

k 

= 8(uv) - 2^ Ci<pi{u, v) - 5{p\ g v) 

i=l 

k I k 

= S(p\ S (r s )V) - ^ Ci(pi(p\ 6(rs) , v) - S(p\ S(rs )V) - ^ Ci6(p\ ms) \') 
1=1 V i=l 

k k 
= - ^ Ci4>i(p\s( rs ), v) + 2^ Ci6(p\^ s) v) 

(=1 i=l 

k k k k 

= ~ c i<Pi(PWr,s), V) ~ ^ Ci<fii(j>\ N (r,s), v) + ^ Ci0(/>U(r,j)V) + ^ C i N (PWns)> V ) 

(=1 !=1 1=1 1=1 

ft k 

= - ^ C|0i(/>Wr,*), V) + ^ Ci0(/>| A ( r ,i)V) 
(=1 i=l 

k k k k 

''=1 7=1 ''=1 7=1 

ft ft 

= - Z c ^OW,*)> v ) + Z c ''^Cpl0((r,i), V), 



i=l 



since the double sums become the same after exchanging ; and j. Since (p(r, s) = 5(rs) we have 
<pi(p\z(f^,v) = <pi(p\g(rs)> v) < w. Thus the first sum is trivial modulo (S, w). Further every term 
iij :- 4>{p\<pi(i\s)^ v ) m the second sum is already in S . So it is just ~k\ Uj for the ★ -bracketed word ★. 
We have 



Thus the second sum is also trivial modulo (S, w). This proves (/, g) w = mod (S, w). 
The proof of the second case is the same. 

(3) ==> (1) Suppose that a <p(x,y) :- 5{xy) - N(x,y) e k[]x,;yU with N(x,y) in DRF is such that 

S := {0O,v)| M ,vek[]Z[]j 

is a Grtibner-Shirshov basis in k[]Z|j for any Z with the order > in Eq. (32). Let a, b,c e !Jft(Z)\{l}. 
For / = (p(ab, c), g - <p(a, be), we have w :- fp — 6(abc) = vg with p — v — 1 . Thus we have an 
intersection composition 



if, gXr-=f~g= ~N(ab, c) + N(a, be). 
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If N(ab, c) = N(a, be), then there is nothing to prove. If N(ab, c) - N(a, be) + 0, then since 
-N(ab, c) + N(a, be) is in Id(5') and S is a Grobner-Shirshov basis, by Theorem 3.13, we have 

-N(ab, c) + N(a, be) = ^ a/?iU, 
i=i 

where a, E k, q t E 9Jt*(Z) and s t e S, 1 ^ i ^ n. This means that -N(ab, c) + N(a, be) is reduced 
to zero by the rewriting system 2^ defined in Eq. (29). Hence (f> is of differential type. 

(4) => (3) Suppose Item 4 holds. Then in particular M(A(Z)) is a linear basis o kyzy//^(Z). Then 
the conclusion follows from ((4) => (1)) in Theorem 3.13. 

(3) => (4) By Theorem 3.13 and Corollary 3.14, M(A(Z)) is a basis of the free 0-algebra 
k[]Z[]//<s(Z) in Proposition 2.10. Therefore, the restriction map 

k(A(Z)> = kM(A(Z)) -> kUZU -> kUZU// (Z) 

is a linear isomorphism. Since kM(A(Z)) is closed under the multiplication on k|JZ[], we see that 
this linear isomorphism is an algebra isomorphism. The recursive definition of the operator d 
follows from the fact that it is the operator 6 on k|]Z|] modulo /^(Z) and hence satisfies 

6{uv) = N(u, v), Vm, v E M(A(Z)). 

□ 

6. Rota-Baxter type operators 

We just give a brief discussion of Rota-Baxter type operators. Their study is more involved 
than differential type operators and will be left to a future work. 

Definition 6.1. We say an expression E(X) e k|]X[] is in Rota-Baxter reduced form (RBRF) if 
it does not contain any subexpression of the form L«JL l 'J f° r an Y M > v £ kp^. 

Definition 6.2. An OPI <p e k[]x, yU is of Rota-Baxter type if it has the form L^J IjJ - [M(x, y)J 
for some M(x,y) E k|Jjc,yU that satisfies the two conditions: 

(1) M(x,y) is totally linear in x,y in the sense that x (resp. y) appears exactly once in each 
monomial of M(x,y); 

(2) M(x, y) is in RBRF; 

(3) M(M(u,v),w) - M(u,M(v,w)) is 11^ -reducible for all u, v, w E k|Jx,yU, where TI^ is the 
rewriting system 

n$:={) L a\\b\^lM{a,b)\ \ a,b E k|]x, 
If (p := lx][y] - [M(x,y)i is of Rota-Baxter type, we also say the expression M(x,y), and the 
defining operator P of a 0-algebra S are of Rota-Baxter type. 

Example 6.3. The expression M(x, y) :- x[y\ that defines the average operator is of Rota-Baxter 
type since 

M(M(u, v), w) - M(u, M(v, w)) = M(u, v)[w} - u[M(v, w)J 

= wLvJLwJ - «LvLwJJ 
h=> mL^L^JJ _ "LvLwJJ = 0. 
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Other examples are OPIs corresponding to a Rota-Baxter operator or a Nijenhuis operator. 



Problem 6.4. (Rota's Classification Problem: Rota-Baxter Case) Find all Rota-Baxter type 
operators. In other words, find all Rota-Baxter type expressions M(x, y) e k\\x,y^. 

We propose the following answer to this problem. 

Conjecture 6.5. (OPIs of Rota-Baxter Type) For any d, A e k, the expressions M(x, y) in the 
list below are of Rota-Baxter type (new types are underlined). Moreover, any OPI of Rota-Baxter 
type is necessarily of the form 

0:= lx\\y\-VM{x,y)\, 

for some M(x, y) in the list. 

(1) x\y] (average operator), 

(2) \_x\y (inverse average operator), 

(3) xjyj+ylxl 

(4) Lxjy + [yjx , 

(5) x\y\ + \_x\y - \_xy\ ( Nijenhuis operator), 

(6) x|_yj + \_x\y + Axy (Rota-Baxter operator of weight A), 

(7) x\y\-x\_\\y + Axy , 

(8) \_x\y - x\\\y + Axy, 

(9) x[y\ + \_x\y - x[l Jy + Axy (generalized Leroux TD operator with weight A), 

(10) x[y\ + \_x\y - xy|_lj - x|_ljy + Axy, 

(11) x\y\ + [xjy - x|_l]y - |_xy] + Axy , 

(12) x\y\ + \_x\y - x[l\y - [l\xy + Axy, 

(13) dx[l}y + Axy (generalized endomorphisms), 

(14) dy\\\x + Ayx (generalized antimorphisms). 

Remark 6.6. Let Z be any set. Recall that the bracketed words in Z that are in RBRF when 
viewed as elements of k|]Z|] are called Rota-Baxter words and that they form a k-basis of the 



free Rota-Baxter k-algebra on Z. See Guo and Sit (2006). Every expression in RBRF is a k-linear 



combination of Rota-Baxter words in k|]x,y|J. 

More generally, if <p(x,y) is of Rota-Baxter type, then the free 0-algebras on a set Z in 
the corresponding categories of Rota-Baxter type 0-algebras have special bases that can be 
constructed uniformly. Indeed, if k{Z}' denotes the set of Rota-Baxter words in k|]Z[], then the 
map 

k{Z}' kyzy -> kyzy// (Z) 

is bijective. Thus a suitable multiplication on k{Z}' makes it the free 0-algebra on Z. This is in fact 
how the free Rota-Baxter k-algebra on Z is constructed when (f>(x, y) is the OPI corresponding to 



the Rota-Baxter operator, the Nijenhuis operator Lei and Guo (2012) and the TD operator Zhou 



(2011) 



7. Computational experiments 

In this section, we give a brief description of the computational experiments in Mathematica 
that resul t in Conjectures 4.7 and 6.5. The programs consist of several Notebooks, available at 
Sitl( |2010| ) in a zipped file. 

Basically, the non-commutative arithmetic for an operated algebra was implemented ad hoc, 
using bracketed words and relying as much as possible on the built-in facilities in Mathematica 
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for non-commutative multiplication, list operations, rewriting, and equation simplification. Care 
was taken to avoid infinite recursions during rewriting of expressions. An elaborate ansatz with 
indeterminate coefficients (like the expression N(x,y) in Theorem 4.11) is given as input, and 
to obtain differential type OPIs, the difference N(uv, w) - N(u, vw) is differentially ^-reduced 
using the rewrite rule system E^. The Rota-Baxter type OPIs are obtained similarly using an 
ansatz M(x,y) and reducing the difference M(M(u, v), w) - M(u, M(v, wj) with the rewrite rule 
system II^. The resulting reduced form is equated to zero, yielding a system of equations in 
the indeterminate coefficients. This system is simplified using the method of Grober bases (a 
heuristic application of Divide and Conquer has been automated). Once the ansatz is entered, 
the "algebras" can either be obtained in one command getAlgebras, or the computation can be 
stepped through. 

The programs provided 10 classes of differential type based on an ansatz of 14 terms, which 
is then manually merged into the 6 classes in Conjecture 4.7. We obtain no new ones after 
expanding the ansatz to 20 terms, including terms such as LWJLLvJJ- The list for Rota-Baxter 
type OPIs are obtained from an ansatz with 14 terms, some involving P(l) (or |_1 J, in bracket 
notation) in a triple product. 

We are quite confident that our list of differential type operators is complete. For Rota-Baxter 
type operators, our list may not be complete, since in our computations, we have restricted 
our rewriting system IT^ to disallow units in order to get around the possibly non-terminating 
reduction sequences modulo the identities. This is especially the case when the OPIs involve |_1J- 
Typically, for Rota-Baxter type OPIs, we do not know how to handle the appearance of [UJ LI J J 
computationally (they may cancel, or not, if our rewriting system 11^ is expanded to include units 
as in Definition 6.2). While expressions involving |_1 J alone may be reduced to zero using an 
expanded rewriting system, monomials involving a mix of bracketed words and |_1 J are often 
linearly independent over k. 

The Mathematica Notebook DTOrderTwoExamples . nb shows the computations for differen- 
tial type operators and the Notebook VariationRotaBaxterOperators.nbdoes the same for 
Rota-Baxter type ones. Non-commutative multiplication is printed using the symbol <g> instead of 
**. It is known that the output routines fail to be compatible with Mathematica, Version 8, and 
we will try to fix this incompatibility and post updated versions on-line. 



8. Summary and outlook 



We have studied Rota's classification problem by considering algebras with a unary operator 
that satisfies operated polynomial identities. For this, we have reviewed the construction of the 
operated polynomial algebra. 

A far more general theory called variety of al gebras exists, of which the theo ries of Pi-rings, 
Pi-algebras, and OPI-algebras are special cases Drensky and Fromanek ( 2004 ). An "algebra" 
is any set with a set of functions (operations), together with some identities perhaps. A Galois 
connection between identities and "variety of algebras" is set up similar to the correspondence 
between polynomial ideals and algebraic varieties. Thus, differential algebra is one variety of 
algebra, Rota-Baxter algebra is another, and so on. 



In mathematics, specifically universal algebra Burris and Sankappanavai ( 1981 ); Cohn ( 1991 ), 
a variety of algebras [or afinitary algebraic category] is the class of all algebraic structures of a 
given signature satisfying a given set of identities. Equivalently, a variety is a class of algebraic 
structures of the same signature which satisfies the HSP properties: closed under the taking of 
homomorphic images, subalgebras and (direct) products. 
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This equivalence, known as the HSP Theorem, is a result of G. Birkhoff, which is of fun- 
damental impo rtance in universal algebra . We re fer interested readers to ( Conn , 1991 , Chap. I, 
Theorem 3.7), ( Burris and Sankappanavai , 1981 , Theorem 9.5) and, for computer scientists with 
a model theory background, ( Baader and Nipkow , 1998 , Theorem 3.5. 14). It is simple to see that 
the class of algebras satisfying some set of equations will be closed under the HSP operations. 
Proving the converse — classes of algebras closed under the HSP operations must be equational — 
is much harder. 

By restricting ourselves to those special cases of Rota's Problem that Rota was interested 
in, and by exploiting the structures of operated algebra and compatibility of associativity on one 
hand, and symbolic computation {Mathematica) on the other, we are able to give two conjectured 
lists of OPTalgebras. 

The project arose from our belief that the construction of free objects in each class of the 
varieties should be uniformly done. Currently, similar results for the known classes are proved 
individually. 

We also believe that there is a Poincare-Birkhoff-Witt type theorem, similar to the enveloping 
algebra of a Lie algebra, where a canonical basis of the enveloping algebra is constructed from a 
basis of the Lie algebra. Here, the free algebra of the variety is constructed from the generating 
set Z with Rota-Baxter words or terms (see Remark 6.6). 

The theory of OPI-rings needs to be studied further and there are many open problems. We 
end this discussion by providing just one. A variety is Schreier if every subalgebra of a free 
algebra in the variety is free. For example, the variety of all groups (resp. abelian groups) is 
Schreier. A central problem in the theory of varieties is whether a particular variety of algebras 
is Schreier. Which of the varieties of differential type algebras or Rota-Baxter type algebras are 
Schreier? 
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